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^ Abstract 

o 
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^ Non-adaptive joint source network coding of correlated sources is discussed in this paper. By 

studying the information flow in the network, we propose quantized network coding as an alternative for 
packet forwarding. This technique has both network coding and distributed source coding advantages, 

o 

CN| simultaneously. Quantized network coding is a combination of random Unear network coding in the 

t— I (infinite) field of real numbers and quantization to cope with the limited capacity of links. With the aid 

HH of the results in the literature of compressed sensing, we discuss theoretical and practical feasibility of 

Q quantized network coding in lossless networks. We show that, due to the nature of the field it operates 

on, quantized network coding can provide good quality decoding at a sink node with the reception of 
a reduced number of packets. Specifically, we discuss the required conditions on local network coding 
coefficients, by using restricted isometry property and suggest a design, which yields in appropriate 
04 Unear measurements. Finally, our simulation results show the achieved gain in terms of delivery delay, 

compared to conventional routing based packet forwarding. 
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I. Introduction 



Flexible, low cost, and long lasting implementation of wireless sensor networks has made them an 
unavoidable alternative for conventional wired sensing structures in a wide variety of applications, 
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including medicine, transportation, and military |[T|. As a relatively new technology, the trends and 
challenges are more felt in the networking aspects of communication than in the classic physical layer 
era |[2|. One of the introduced challenges is the gathering of sensed data at a central node of the network, 
where delivery delay, precision, and robustness to network changes are emerging issues. 

As the conventional way of transmission in the networks, packet forwarding via routing is widely used 
in different implementations of sensor networks. While it achieves capacity rates in the case of lossless 
networks ||3|, packet forwarding requires an appropriate routing Q protocol to be run. In the case of 
correlated sources, distributed source coding ||5|, ||6| on top of packet forwarding is proved to be optimal, 
in terms of achieved conditional information rates (7] . However, packet forwarding can lead to difficulties 
because of its need for queuing, and its slow adaptation to network changes, caused by deploying new 
node(s) or link failure(s). 

These issues and a lot more have motivated the invention of network coding |3 |, as an alternative for 
packet forwarding in sensor networks |[8|, ||9l. Specifically, network coding sends a function of incoming 
packets to the intermediate nodes, as opposed to sending their original content. Furthermore, the usage 
of random linear functions, also known as random linear network coding, is proved to be sufficient in 
lossless networks pO| , pT| . Moreover, theoretical analysis shows that when network coding is used for 
transmission, no queuing is required to achieve the optimal information rates Q. Network coding in 
lossy networks can result in improved achieved rate regions, compared to packet forwarding |12|, p3) . 



Similar to packet forwarding, network coding can be separately applied on top of distributed source 
coding for correlated sources p4| , |15|. On the other hand, one has to perform joint source network 



decoding in order to achieve optimal performance limits, which may not be feasible because of its 
computational complexity [15]. Sub-optimal solutions have been proposed to tackle this practicality issue 



|16|-|18|, by using low density codes and sum product algorithm |19| for decoding. Similar to the 
distributed source coding, which requires knowledge of appropriate marginal rates at each encoder node, 
these approaches need some knowledge of correlation model of sources, at the encoders' side. This 
knowledge of appropriate rates may be a luxury in some cases, especially when it is changing over 
time and needs to be updated frequently. Hence, it is essential to study the possibility of developing a 
non-adaptive joint source network coding for such cases. In this paper, we aim to develop a non-adaptive 
random linear network coding for efficient joint distributed source network coding of correlated sources 
in sensor networks. 



Recently, the idea of using compressed sensing |20|, |21 1 and sparse recovery concepts in sensor net 



works has drawn attention p2[-p5|. For instance, in |26|, |27|, theoretical discussion on sparse recovery 
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of graph constrained measurements with an interest in network monitoring application is presented. Joint 
source, channel and network coding was also proposed in [28], where random linear mixing was proposed 
for compression of temporally and spatially correlated sources. In |29], practical possibility of finite field 
network coding of highly correlated sources was investigated, with the aid of low density codes and belief 
propagation base decoding. Unfortunately, a solid theoretical investigation on the feasibility of adopting 
sparse recovery in random linear network coding has not been done previously. 



In our earlier work |30|, we proposed non-adaptive joint source network coding of exactly sparse 
sources, with the aid of the results in compressed sensing literature. In this paper, we extend our work 
to the general case of correlated sources and discuss theoretical and practical aspects of having robust 
distributed compression. 

A detailed description of data gathering scenario with our notations is presented in section [II] In 
section [nil we introduce and formulate our proposed quantized network coding, which is followed by its 



theoretical feasibility discussion using restricted isometry property, in section IV In section |V| we present 



the decoding algorithm used to recover quantized network coded packets, and derive a performance bound 



on its recovery error. Our simulation setup and results are presented in section VI Finally in section VII 



we conclude the paper by discussion on our proposed method and the ongoing works on this topic. 

II. Problem Description and Notation 

In this paper, we consider a lossless model of networks, for which the links have limited capacities. 
Although it may not be a perfect model in practical cases where the links have mutual interference, it 
still reflects the effect of such imperfectnesses when calculating single input single output capacity of 
the links. A future work may study the case of noisy networks of links, by understanding the effect of 
interference between the links. 

As shown in Fig. [TJ we represent the network by a directed graph, Q = {V,£), where V and £ 
are the sets of nodes (vertices) and directed edges (links). Each node, v, is from the finite sorted set 
V = {!,••• and each edge, e, is from the finite sorted set £ = {!,••• ,\£\}- Further, each edge 
(link) can maintain a lossless transmission from tail{e) to head{e), at a maximum finite rate of Cg bits 
per use. We define the sets of incoming and outgoing edges of node v, denoted by In{v) and Out{v), 
respectively, as follows: 

In{v) = {e : e £ £, head{e) = v}, (1) 
Out{v) = {e:ee£, tail{e) = v}. (2) 
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The input and output contents of edge e at time instant t are represented by Ye{t) and Y^{t), where t 
represents the discrete (integer) time index, during which a block of length L is transmitted. Since the 
edges are lossless, and Y^{t) are the same and from a finite alphabet of size [2^^-\, where [.J 

denotes truncation to the lower integer. In the rest of the paper, the realizations of all capital letter random 
variables are denoted by lower case letters. 

The nodes of the network are equipped with sensors and specifically each node v has an information 
source, Xy, where Xy G R. The sensed data are supposed to be correlated, as this is a valid assumption in 
a lot of different applications. We model the correlation between these sensed data, by the near-sparseness 
property, since it can be considered as a generalization of compressibility and sparseness. Specifically, 
by defining the sorted vector of Xy's: 

X=[X,:v£V], (3) 

we assume that X is near-sparse in some orthonormal transform domain (/)„xn {^Explicitly, for 5 = 
and a small positive e^j, we have: 

\\S-S,\\,^<ek, (4) 



where Su is such that: 



I^S'fcl 1^0 — k, (5) 



and is called /c-sparse. An example of the sparsifying transform matrix, (p, is the Karhunen Loeve transform 
of the messages. 

Having these correlated information sources and the information network characterized, we study the 



'in this paper, all the vectors are column-wise. 
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Fig. 2. A simple diagram of quantized network coding. 



transmission of X^'s to a single gateway node. The gateway or decoder node, denoted by vq, vq G V, 
has high computational resources and is usually in charge of forwarding the information to a next level 
network; e.g. a wired backbone network. The described (single session) incast of sources to the unique 
decoder node is referred to as data gathering. The purpose of this paper is to discuss the theoretical and 
practical feasibility of non-adaptive joint source network coding in the described data gathering scenario. 
More specifically, we take a compressed sensing approach in order to handle the transmission of sensed 
data. 



III. Quantized Network Coding 

Random linear network coding for multicast of independent sources has been proposed and studied in 
pT| , where the algebraic operations are in finite field. Since our work is motivated by the concepts of 
compressed sensing, in which the results are valid in the infinite field of real number, we have to use a 
real field alternative for conventional finite field network coding. On the other hand, finite capacity of 
the edges has to be appropriately coped with the infinite number of symbols in the adopted real field 
network coding. As a result, we propose Quantized Network Coding (QNC), which uses quantization to 
bridge between the limited capacity of the links and infinite alphabet of real field network coded packets. 



In |30|, for Vf G V,Ve G Out{v), we defined QNC at node v, according to: 



i^e(t)=Qe( /3e,e'(t)-i^e'(t-l)+ae,4t)-^.), (6) 

e'£7n(t)) 

where Y(,{1) = 0, Ve G £, ensures initial rest condition in the network. The messages, X^'s are assumed 
to be constant until the transmission is completej^ The local network coding coefficients, Pe,e'{tys 
and ae,i;(t)'s are real valued and ai^e usually picked semi-randomly. The quantizer operator, Qe("), 

^This is why X„'s do not depend on t. 
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corresponding to outgoing edge e, is designed based on the values of Ce and L, and the distribution of 
its input {i.e. random linear combinations). A simple diagram of QNC at node v is shown in Fig. [2] 
Denoting the quantization noise of Qe(.) at time t, by Ne{t), we can reformulate ^ as follows: 

e'€ln{v) 

We denote the adjacency matrix, [-F'(t)]|£'|x|£'|> and [^(t)]|£-|xn rnatrix, such that: 

( I3e,e'(.t) , tail{e) = head{e') 
I , otherwise 

{aev(t) , tail(e) = v 
, otherwise 

We also define the vectors of edge contents, Y^{t), and quantization noises, N_{t), according to: 

Y{t) = [Ye{t) : e e £], (10) 
N{t) = [Neit) : e e £]. (11) 

As a result, Eq. [7] can be re-written in the following form: 

Yit) = F{t) ■ Y{t - 1) + A{t) ■ X + N{t). (12) 

Depending on the network deployment, matrix [i?]|/n(t,„)|x|£'| defines the relation between the content of 
edges, and the received packets at the decoder node. Explicitly, we define the vector of marginal 

measurements (received packets) at time t at the decoder: 

Z{t) = [Ye{t) : e e In{vQ)] = B ■ Y{t), (13) 

where: 



1 , i corresponds to e, e £ Inivn) 

■ (14) 

, otherwise 



By considering (12i as the difference equation, characterizing a linear system with X and -/V(t)'s as 



its inputs, and Z_{t) its output, and using the results in |31 1, {Z{t)}i's are given by: 



m = '^it)-K + N,sit), (15) 
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where the marginal measurement matrix, ^{t), and the marginal effective noise vector, N^Q(t), are 
calculated as follows: 



t t'+i 



t'=2 t"=t 
t t'+l 



KAt) = B.Y,'[\F{t")N{t'). 

t'=2 t"=t 

In Eqs. 16|17 the matrix multiplication is defined as: 



(16) 
(17) 



t'+i 



llFit") = Fit)...F{t' + l). 



(18) 



t"=t 



By storing Z(t)'s, at the decoder, we build up the total measurements vector, Z_^^at{t), as follows: 

Z(2) 



Z{t) 



(19) 



mx 1 



where m = {t — l)\In{vo)\. Therefore, the following can be established: 



(20) 



where the m x n total measurement matrix, ^tot{t), and the total effective noise vector, iVefftot(0' 
are the concatenation result of marginal measurement matrices, ^'(t)'s, and marginal effective noise 
vectors, N^gjt). Because of our assumption to start transmission from t = 1, {Z(l)}j's are not useful 
for decoding, and therefore: 



*tot(t) 



(21) 



iVeff(2) 



(22) 



In the conventional linear network coding, the number of total measurements, m, is at least equal to 
the number of data, n. More precisely, the total measurement matrix is of full column rank, which makes 
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US able to uniquely find a solution|^ In this paper, we are interested to investigate the feasibility of robust 
recovery of X, when fewer number of measurements are received at the decoder than the number of 
messages; i.e. m < n. 



Considering the characteristic equation of (20 1, describing the QNC scenario, we can treat as a 



compressed sensing measurement equation. This gives us an opportunity to apply the results in the 



literature of compressed sensing and sparse recovery |20|, |32| to our QNC scenario with near-sparse 
messages. However, one needs to examine the required conditions which guarantee sparse recovery in 
the proposed QNC scenario. In the following, we discuss theoretical and practical feasibility of robust 
recovery with a compressed sensing perspective. 

IV. Restricted Isometry Property 

One of the advantageous of compressed sensing is to tackle a non-adaptive design for sensing of sparse 
signals, where the support (location of non-zero elements) is not known at the encoding side. To pay back 
this non-adaptive characteristic, we may need more measurements than the exact number of non-zero 
elements. Fortunately, if appropriate types of linear measurements are chosen, we can keep the required 
number of measurements much less than the number of messages; that is: m <C n. 

One of the properties that is widely used to characterize appropriate measurement matrices in the 



compressed sensing literature, is the Restricted Isometry Property (RIP) |33|. Roughly speaking, it 



provides a measure of norm conservation while the dimensionality is reduced |34|. An m x n matrix 



0tot(i) is said to satisfy RIP of order k with constant 6^, if for all fe-sparse vectors G M", we have: 

1-Sk< , 2 <l + 5k. (23) 

Remark 4.1: Random matrices with identically and independently distributed (i.i.d) zero mean Gaus- 
sian entries are appropriate measurement matrices for compressed sensing. Explicitly, an m x n i.i.d 
Gaussian random matrix, denoted G, with entries of variance ^, satisfies RIP of order k and constant 
6k, with a probability exceeding 

1 - e-'^i™, (24) 



(called overwhelming probability) if 



m > K2k\og{-). (25) 



'beyond the fact that there should not be any uncertainty involved as a result of noise. 
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In (24 1, (25 1, Ki and K2 only depend on the value of 5k (theorem 5.2 in [35|). 



In 1 30 1, ||36|, we proposed a design for local network coding coefficients, /3e e'(i)'s Oie,v{tY^, which 



results in an appropriate total measurement matrix, '^x.ot{t), in the compressed sensing framework. 

Theorem 4.2: (Theorem 3.1 in |36|) Consider a quantized network coding scenario, in which the 
network coding coefficients, ae,^(t) and /3e,e'(i), are such that: 

. ae,^(t) =0, yt > 2, 

• ae,i)(2)'s are independent zero mean Gaussian random variables, 

• /3e,e'(i)'s are deterministic. 

For such a scenario, the entries of the resulting ^tot(i) are zero mean Gaussian random variables. 
Further, the entries of different columns of \I'tot(i), i-e- {^tot{t)}i,v and {^I'tot(^)}^',D', where v / v' , are 
independent. ■ 

It is also numerically shown in ||36| that locally orthonormal set of /3e,e'(0's ^ better choice than 
non-orthonormal sets; that is for all e, e' E Out{v), we have: 



Pe,e"{t)-f3e',e"it) = 0, 6 ^ e' , 

e"&In(v) 

J2 ^le"it) = 1. 



(26) 
(27) 



e"(iln(v) 



In 1 36 1, we established the relation between the satisfaction of RIP and the tail probability 



Ptaii(1'totW,e) = maxPf ll^-totCik'H! - 1 
subject to: | \x\\^^ = 1 



(28) 



by proving the following theorem. 



Theorem 4.3: (Theorem 4.1 in |36|) Consider ^'tot(i) with the tail probability, as defined in (28 1, and 
an orthonormal transform matrix (j). Then, 0tot(t) = ^tot(i) • </> satisfies RIP of order k and constant 5k, 
with a probability exceeding. 




.42 



Ok 



(29) 



By using theorem 4.3 we can analyze the behavior of ^tot {t), resulting from the proposed local network 



coding coefficients in theorem |4.2| Specifically, we try to see if we can obtain the same tail probability 
as a Gaussian ensemble, with the same order of measurements. Unfortunately, the complicated relation 
of local network coding coefficients and network parameters with the resulting ^tot {t) (see Eqs. Isl |9] 
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16 21) makes it difficult to derive a simple mathematical form for the tail probability, p^j^Q(\I'tot(i)) e)^ 
and have a nice mathematical conclusion about the required number of measurements. 

In Fig. [3] we present the numerical values of tail probabilities (defined in Eq. 28 1 for the resulting 



^tot(i)> Ptaii(^tot(i)) using the proposed local network coding coefficients in theorem 4.2 These tail 
probabilities are compared with those of i.i.d Gaussian matrices, G, versus the number of measurements, 
m, in each caseQ 

Remark 4.4: Our numerical evaluations in Fig. |3] show that for the same value of tail probability, there 
is a QNC resulting measurement matrix, ^'tot(i)> and an i.i.d Gaussian matrix, G, which have the same 



order of measurements, m. Furthermore, using theorem 4.3 we can say the the resulting ^'tot(i) has a 
similar behavior as Gaussian matrices, in terms of RIP satisfaction. 

In the following section, we use the aforementioned conclusion for the resulting ^'tot(i) to derive a 
performance bound for QNC scenario. 

V. Decoding using Sparse Recovery 



Sparse recovery for exactly sparse data can be done by using linear programming |37|, where NP- 
hard Iq minimization is replaced by l\ minimization. Fortunately, this alteration of cost function does 
not affect the optimality in recovery of exactly sparse vectors from noiseless measurements | |32| , ||37|. 
However, when dealing with noisy measurements, ^i-min recovery does not necessarily offer an optimal 
solution. There is still a lot of work being done to develop practical and near-optimal recovery algorithms 
for noisy cases. In the following, we discuss ^i-min recovery for QNC scenario and establish theoretical 
bounds on its recovery error. 



Motivated by the work in |20|, |33|, the compressed sensing based decoder for QNC scenario solves 



the following convex optimization: 



Kit) = (/>-argmin||5'|L , (30) 

s_' *i 

subject to: | \Z^^t{t) - ^'tot(t) </> S'| < e^ec(t) 



which can be solved by using linear programming |37|. In the following, we present our results on the 



recovery error using ^i-min decoding of Eq. 30 



Theorem 5.1: Consider a QNC scenario where, for all w G V, the network coding coefficients satisfy 
''Detailed version of our calculations for the tail probability of \['tot(i) can be found in 36 
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Fig. 3. Logarithmic tail probability versus logarithmic ratio of minimum required number of measurements in our QNC scenario 
and i.i.d. Gaussian measurement matrices, for n = 100 nodes, different RIP constants, and different number of edges . 



the following normalization condition: 

\l3e,e'{t)\ + \ae,v{t)\ < 1, Vc G Out{v), Vt. (31) 

e'£/n(i)) 

In such scenario, we assume that the resulting Btot(i) = ^tot(i)0 satisfies RIP of order 2k with constant 
62k, where 62k < — 1. Moreover, the messages, X^s, are supposed to be bounded between —qmax 
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t t'-l 



t"'=t"+2 



t'-l t"'=t"+2 



w=iE(EAQ| n ^(^'")| -B-B-Y^i n Fit' 



t'=2 t"=l 



t"=l 



(33) 



and +qmax, and the edge quantizers, Qg(.)'s, are uniform with the step size 

2q 

max 



A. 



(32) 



Now, for the £i-min decoding of (30 1 where e'^^^{t) is as defined in Eq. 33 and Aq = [Ag : e G we 
have: 



X{t) - X 



(34) 



In the inequality of (34i, c\ and C2, are constants, defined as follows: 



ci 



C2 



'l-(l + ^/2)52fc' 



(35) 
(36) 



Proof: Since the network is lossless and network coding coefficients satisfy the condition of Eq. 3 1 



and < qmax^ V v, the only associated measurement noise is resulting from the quantization noise 
at the edges. Moreover, for each e G we have: 



^<iVe(t)<+^, 



(37) 



since the quantizers are uniform. Equivalently, the absolute value vector of iV(t), represented by iV(t) 
is such that: 



(38) 



Since i? is a one-to-one mapping matrix with positive entries, the effective noise vector, iVofj(f), can be 
upper bounded as follows: 

t-l t"=t'+2 



p E n nniv(t'+i) 

v=\ t 

t-1 t"=t'+2 

B-\Y, n F{t")K{t'+i 



t'=l t 



(39) 
(40) 
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Therefore, using (38 1, we have: 



t-l t"=t'+2 



t'=l t 

i-1 t"=t'+2 



t'=i t 

t-l t"=t'+2 



< B-Y, n ^(^"^ 



t'=i t 



(41) 
(42) 
(43) 



Finally, by using inequality of (43 1, 



|iVeff,totW||', =Ell^es(i') 



t'=2 



and. 



we can show that: 



.eff,tot 



it)\\l<eUt), 



(44) 



(45) 



(46) 



such that erec(i) is as defined in Eq. 33 Now, by applying theorem 4.2 in |21 1, and using the definition 



of e/c in (|4]), we can finish the proof of our theorem. ■ 
According to the preceding theorem, the upper bound, ciereo is decreased when the quantization 
steps, Ae's, are decreased, too. And since Ae = 2qmax/['2^'^° \, a smaller upper bound on the ^2-norm 
of recovery error is forced by increasing the block length, L. Although this can be done practically, it 
will simultaneously increase the point to point transmission delays in the network, which may not be 
desirable. Introducing a trade-off on the choice of block length, one has to find its appropriate value for 
a specific quality of service (i.e. recovery error). 



Based on theorem 5.1 if the resulting ^'tot(i) satisfies RIP of appropriate order with a high probability, 
then the robust recovery can be guaranteed. On the other hand, using remarks 4.1|4.4 we can say that 
the resulting ^'tot(i) satisfies RIP with a high probability, while the number of measurements, m, has 
a smaller order than the number of messages, n. Therefore, putting all these numerical and theoretical 



results together, it is true to say that QNC can result in bounded error recovery ( 34 1 with a smaller order 
of measurements (received packets at the decoder) than that of messages. This saving in the required 
number of received packets can be interpreted as an embedded distributed compression, achieved by 
quantized network coding at the nodes. 
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TABLE I 

The parameters of messages and the networks, used in our simulations. 



Parameter 


Value(s) 


No of nodes, n 


100 


No of edges, \£\ 


1100, 1400, 1800 


Block length, L 


1,...,40 


Sparsity factor, k/n 


0.05,0.15,0.25 


Near-sparsity factor, e^/ 


0,0.002,0.02,0.2 


Range of messages 


[-10, +10] 


Average x 


41.7 ~ 32.4 [dB] 



VI. Simulation Results 

In this section, we evaluate the performance of quantized network coding, by using different numerical 
simulations. We are interested to find out the compression achievements, resulting from QNC, by obtaining 
the delay-distortion curves in different scenarios. 

Although we were able to derive mathematical performance measures for the QNC scenario, they are 
not comprehensive and do not offer any guarantee on the statistical performance measures; e.g. mean 
squared error. However, deriving such statistical performance bounds requires a lot more of theoretical 
work on the sparse recovery, and meanwhile we can only rely on the numerical evaluations. 

We initiate our numerical evaluations, by comparing the delay-quality performance of QNC and 
conventional routing based packet forwarding for lossy transmission of a set of correlated sources 
(messages). To set up the simulations, we randomly generate random deployments of directed networks 
with uniformly distributed edges (making sure there is not any pair of nodes with two assigned edges). 
The edges can maintain a lossless communication of one bit per use, meaning Ce = 1, for all e £ £. 
One of the nodes is randomly picked to be the gateway node, vq, in which the messages are decoded. To 
generate a realization of messages, x, we first generate a A;-sparse random vector, s^, whose components 
are uniformly distributed between — ^ and + 1 - A near-sparse vector, s, is obtained by adding a zero mean 
uniform noise, such that ||s — S;j,||^^ is bounded by e^. This is followed by generation of an orthonormal 
random matrix, 0, and calculating random messages; x = 4> ■ s, and normalizing the range of x^'s, 
between —qmax and +qmax, where Qmax = 10. Different values of sparsity factor, ^, and are used in 
our simulations. A summary of the simulation parameters is presented in Table |Ij 

For each generated random network deployment, we perform QNC with ^i-min decoding. Local net- 
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work coding coefficients, ae,^(t)'s and /3e,e'(*)'S' generated according to the conditions of tlieorem 4.2 



The freedom degrees are limited by picking /3e,e'(0 's ^^ch that they are locally orthonormal; The resulting 



coefficients are then normalized to satisfy the normalization condition of Eq. 3 1 and prevent overflow in 
the linear combination of QNC. Edge quantizers, Qg(.)'s, are uniform with a range of [—qmax, +Qmax] 
and 2^ intervals (since Cg = 1, Ve). This completes all the required parameters and vectors to simulate 
quantized network coding and obtain the received packets at the decoder node, z(t)'s|^ Random ae,i,(2)'s 
can be generated in a pseudo-random way and therefore only the generator seed needs to be transmitted 
to the decoder as a header. 

At the decoder, the received measurements up to t, z^^i{t), are used to recover the original messages. 
Specifically, for a realization of messages, x, we define XQ^Q{t), to be the recovered messages, using 
£i-min decoding, according to (l30|). Moreover, the convex optimization, involved in ([SO]) is solved by 



using the open source implementation of disciplined convex programming |38|, |39|. 

For each deployment, we also simulated a routing based packet forwarding and compare it with the 
results for QNC. To find the routes from each node to the gateway node, we find the shortest path from 



each node to the gateway node, using the Dijkstra algorithm |40|. Further, the real valued messages, x^'s, 
are quantized at their corresponding source nodes, by using similar uniform quantizers, as used in QNC 
transmission. It is aimed to deliver all Xv 's to the decoder node and keep the track of delivered messages 
over time, t, in the recovered vector of messages, Xpp{t). Moreover, if a message, Xy, is not delivered 
by time index t, zero is used as its recovered value: 

{xpF(t)}. = 0. (47) 

The £2 norm of recovery error, ||a; — is used as the quality measure in our numerical com- 

parisons. The payback measure in our comparisons is the delivery delay, corresponding to achieve a 
minimum quality of service. Explicitly, delivery delay for a transmission which has terminated at t is 
equal to {t — l)L in both cases of QNC and packet forwardingj^In QNC scenario, for each value of ^, and 
ek, we calculate the average of | |x — £qnc(*)| |^ 's over different realizations of network deployments. 
Since the sparsity of messages does not affect the performance of packet forwarding, we only need to 
present its results for different network parameters {i.e. number of edges). 

For a fixed block length, L = 20, the average of £2 norm of recovery error versus the average delivery 

^Lower case notations are used for realization of random variables. 

*In the case of packet forwarding, we do not consider the learning period, required to find the optimal routes. 
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(a) 1100 edges (b) 1400 edges 

Fig. 4. Average i'2-norm of recovery error versus delivery delay for QNC and PF scenarios, when L — 20, ek — and 
\£\ = 1100,1400. 



delay is depicted in Fig. |4] In Figs. 4(b)|4(a) the horizontal axis represents the product {t — 1)L, which 
is the delivery delay, corresponding to L = 20, for different values of t > 1. The vertical axis is the 
logarithmic average £2 norm of recovery error, 201ogxo \ \x — x\\^^, for QNC and Packet Forwarding (PF) 
scenarios. Simply, Figs. 4(b)|4(a) can be considered as rate-distortion curves in a lossy source coding 
scenario. 

As it is shown in Figs. 4(b)|4(a) when using the same block length, QNC achieves significant 
improvement, compared to PF, for low values of delivery delay. These low delays correspond to the initial 
t's in the transmission, at which a small number of packets are received at the decoder, as expected. 
After enough packets are received at the decoder, QNC achieves its best performance (at around —20 
[dB]), as a result of associated quantization noises. The best performance for packet forwarding happens 
after a longer period of time than for QNC. On the other hand, the best performance of PF (around —80 
[dB]) is higher than that of QNC, which can be explained by noise propagation in the network during 
QNC. However, as it is shown in the following, QNC outperforms PF in a wide range of delay values, 
when the appropriate block length is adopted in each case. 

After simulating QNC and PF scenarios for different block lengths and calculating the corresponding 
delay and recovery error norms, we find the best values of block length for each specific average £2 norm 
of recovery error (as a measure of quality of service). The resulting L-optimized curve for each QNC and 



December 24, 2012 



DRAFT 



17 



PF scenario is depicted in Fig. |5] In Figs. 5(a) 5(f) QNC performance is compared with that of PF, for 



different number of edges, different sparsity factors, and near-sparsity parameters. Generally speaking, 
these figures show a promising improvement over conventional packet forwarding, when QNC is adopted 
for transmission of near-sparse messages. The achieved improvement is increased as the sparsity factor, 
^, is decreased, meaning a higher level of correlation between the messages. 

As a drawback, QNC seems to fail when the sparsity model is not good for describing the correlation 
model. Specifically, if the near-sparsity parameter, e^, is too high, then the resulting performance of 



QNC can not even achieve that of PF, for a wide range of delivery delays (see Fig. 5(b) for instance). 



In Figs. 6(a)|6(b)|6(c) the effect of on the resulting QNC performance is illustrated. As it is shown. 



as long as is small (relative to the li norm of message), there is not any difference in the QNC 
performance. But, if it is so high that the sparsity model does not characterize the messages fairly, then 
QNC fails to work properly (since li min decoding criteria is not a good cost function anymore). 

In the routing based packet forwarding scenarios, the intermediate (sensor) nodes have to go through 
route training and storage of packets. As one of the main advantages of network coding, in QNC scenario, 
the intermediate nodes should only carry simple linear combination and quantization, being liberated in 
terms of computational complexity. On the other side, at the decoder sides, QNC requires an £i-min 
decoder which is potentially more complex than the receiver required for packet forwarding. However, 
this may not be an issue in practical cases, as the gateway node is usually capable of handling high 
computational operations. 

VII. Conclusions and Future Works 

Joint source network coding of correlated sources was studied with a sparse recovery perspective. In 
order to achieve non-adaptive encoding, we proposed quantized network coding, which incorporates real 
field network coding and quantization to take advantage of decoding using linear programming. Thanks 
to the work in the literature of compressed sensing, we discussed theoretical guarantees to ensure efficient 
encoding and robust decoding of messages. Moreover, we were able to make conclusive statements about 
the robust recovery of messages, when fewer number of received packets than the number of sources 
(messages) were available at the decoder. Finally, our computer simulations verified the reduction in the 
average delivery delay, by using quantized network coding. 

Although the proposed sparse recovery algorithm is working well for correlated messages with near- 
sparse characterization, it does not offer optimal recovery for other cases of correlated sources. Currently, 
we are studying the feasibility of near-optimal decoding, when other forms of prior information are 
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available about the source. Specifically, we have suggested the use of belief propagation based decoding 



|41|, |42| in a Bayesian scenario. However, more theoretical work is needed to derive mathematical 
guarantees for robust recovery. Studying the general case of lossy networks with interference between 
the links is also one of the urging needs for our work. 
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Fig. 5. Average ^2-norm of recovery error versus average delivery delay for QNC and PF, and different values of et- 
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Fig. 6. Comparison of QNC versus PF performance for different near-sparsity parameters, et . 
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